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(54) Method and apparatus for multimedia editing. 

(57) A specialized linked -list editing structure is 
used to order multimedia file segments in a 
multimedia file to be edited. Each multimedia 
file segment is comprised of a number of con- 
tiguous data units, which may preferably be 
bytes, that are portions of the overall mul- 
timedia file even though the file segments may 
be physically located in different data files. The 
linked list is arranged as a plurality of nodes 
where each node represents a single file seg- 
ment and the linked list orders all of the file 
segments to make up the entire multimedia file. 
Accordingly, editing can be performed at the 
data unit level so that both compressed and 
uncompressed files can be handled. Editing 
operations on the file result in changes to this 
linked-list structure instead of the file itself, thus 
avoiding the necessity of making file copies. 
More particularly, the linked-list structure con- 
sists of a list of records called file descriptor 
nodes". Each node comprises a record which 
contains information about a corresponding file 
segment, including, the address of the physical 
file in which the segment is located, the physi- 
cal position of the segment in its file, the length 
in data units of the segment and a "logical 
starting position" number which indicates the 
position of the file segment relative to other 
segments in the overall multimedia file so that a 
particular segment can be located during a seek 
operation. 
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FIELD OF THE INVENTION 

This invention relates to methods and apparatus 
for editing multimedia data files, including com- 
pressed and uncompressed audio and video files. 

BACKGROUND OF THE INVENTION 

"MULTIMEDIA" computer systems are gaining 
popularity in many markets. A typical multimedia 
computer system can receive analog audio and video 
information, process the information and store it as 
digitized signals. The stored audio and video informa- 
tion can then be edited and reproduced in a coordin- 
ated manner. 

Such multimedia systems typically comprise 
both computer software and specialized computer 
hardware that provides an interface between the 
computer and analog video and audio processing 
components, such as microphones, speakers, cam- 
eras and tape recorders. During a process called re- 
cording," the specialized hardware periodically sam- 
ples an incoming analog signal and encodes the am- 
plitude of each signal sample into a digital word. The 
resulting stream of digital words forms a set of digi- 
tized data that can be manipulated by the computer. 
The incoming digitized data is typically stored on a 
disk or other large scale storage system as a multime- 
dia data file where the data can be edited and later re- 
converted to an analog signal by means of other com- 
puter hardware during a process called "playback." 

Although the samplingf requency and the number 
of bits used to encode each sample determine the ac- 
tual amount of space required to store a given multi- 
media file, in general, the storage space required is 
relatively large. Consequently, multimedia data files 
are often processed by using further encoding tech- 
niques to reduce the required storage space in a proc- 
ess that is typically called "compression." Some of the 
more conventional compression techniques include 
Adaptive Pulse Code Modulation (APCM), u-law, and 
Run-Length Encoding (RLE). Agiven digital signal file 
is either totally uncompressed or totally compressed, 
however, it is common to operate in environments 
where some multimedia files are compressed, while 
others are not. 

Once digitized information has been stored, it is 
possible to edit the stored information (and, conse- 
quently, the reproduced analog signal) by means of 
software that allows a user to directly manipulate the 
stored digital signals. There are many commercially 
available software applications that can perform 
such editing operations as insertion, deletion and 
overwriting selected portions of the data. Some soft- 
ware also provides for data recovery that allows one 
or more previous editing operations to be reversed or 
undone . Other software includes journaling ability or 
the ability to redo editing operations that have been 



undone during a data recovery operation. 

For example, generic database software typical- 
ly can perform data recovery and journaling opera- 
tions, however, conventional generic database can- 
5 not correctly edit multimedia data and cannot correct- 
ly save the state of multimedia files. Further, conven- 
tional database software does not properly operate 
with compressed multimedia files. 

In order to overcome these difficulties prior art 
10 approaches have developed application software de- 
signed specifically for editing multimedia files, such 
as digital audio. These digital editor applications have 
implemented editing support for both compressed 
and uncompressed files, however there are limita- 
15 tions. For example, prior art digital multimedia editing 
applications have relied on disk storage to save the 
data and, in order to ensure data integrity, such ap- 
plications typically make a copy of a file and perform 
editing on the copy by directly changing the ordering 
20 of the copy. The time required to copy relatively large 
multimedia files and move sections of the files makes 
such editing operations relatively slow. 

In addition, prior art digital editors often have 
poor data recovery support Unlike word processors, 
25 conventional digital editors do not offer unlimited 
undo/redo capability due to the expense generally in- 
volved in implementing such features. Further, since 
each specialized editing application must include 
complete editing support for every type of multimedia 
30 file, every such application must include essentially 
the same editing code, resulting in a much larger 
overall program. Large programs, in turn, entail main- 
tenance difficulties and coordination problems since 
multiple vendors must attempt to fix similar bugs. 
35 In order to overcome the latter difficulty, at- 

tempts have been made to incorporate multimedia 
editing support directly into a computer operating sys- 
tem. This approach has the advantage that each dig- 
ital editing application does not have to duplicate the 
40 same code thereby eliminating the maintenance dif- 
ficulties associated with the separate application pro- 
grams. However, existing operating environments 
contain only rudimentary digital editing support. For 
example, a popular operating system called Microsoft 
45 WINDOWS™ 3.1 developed and sold by the Micro- 
soft Corporation, Redmond, Washington, does pro- 
vide facilities for multimedia file manipulation. How- 
ever, the editing facilities available only allow over- 
write of a file and insertion into a file. Other editing 
so functions, such as deletion, data recovery and jour- 
naling are not available and the program cannot edit 
compressed files. Another prior art system called the 
Multimedia Presentation Manager 2 (MMPM/2) mar- 
keted by the International Business Machines Cor- 
55 poration, Boca Raton, Florida, has the same simple 
facilities as the above-mentioned WINDOWS™ pro- 
gram. 

A further prior art program called QUICKTIME® 
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marketed by the Apple Computer Corporation, Cuper- 
tino, California, has relatively sophisticated editing 
functions which allow sections of media to be cut 
and/or copied and pasted into other media types. 
However, this latter program also has limitations in 
that it has limited data recovery and journaling sup- 
port and it can only work with quickti me® file formats. 

The prior art has not provided a multimedia file 
editing and data recovery system which can accurate- 
ly and rapidly edit multimedia files with minimized 
memory use. 

DISCLOSURE OF THE INVENTION 

Accordingly, the present invention provides ap- 
paratus for editing a multimedia file comprised of a 
sequential plurality of data units generated by sam- 
pling an analog signal and encoding each sample as 
a data unit, and each of the plurality of data units be- 
ing located in a physical file having an address indi- 
cating the start of the physical file and a physical file 
length, the apparatus operating under control of an 
editing application and comprising: means for con- 
structing a node representing a sequential plurality of 
data units comprising a segment of the multimedia 
file, the node comprising the physical file address, a 
physical position of the represented file segment in 
the physical file, a logical starting position indicating 
the position of the represented file segment in the 
multimedia file and the number of data units in the 
represented file segment; and editing means respon- 
sive to editing commands generated by the editing 
application for changing information contained in the 
node in order to edit the represented file segment. 

In another aspect, the invention provides a meth- 
od for editing a multimedia file comprised of a se- 
quential plurality of data units generated by sampling 
an analog signal and encoding each sample as a data 
unit, and each of the plurality of data units being lo- 
cated in a physical file having an address indicating 
the start of the physical file, the method operating in 
cooperation with an editing application and compris- 
ing the steps of: constructing a node representing a 
sequential plurality of data units comprising a seg- 
ment of the multimedia file, the node comprising the 
physical file address, a physical position of the repre- 
sented file segment in the physical file, a logical start- 
ing position indicating the position of the represented 
file segment in the sequential plurality of data units 
in the multimedia file and the number of data units in 
the represented file segment; and changing informa- 
tion contained in the node in order to edit the repre- 
sented file segment in response to editing commands 
generated by the editing application. 

In one illustrative embodiment of the invention, a 
specialized linked-list editing structure is used to or- 
der multimedia file segments. Each multimedia file 
segment is comprised of a number of contiguous data 



units, which may preferably be bytes, that are por- 
tions of the overall multimedia file even though the 
file segments may be physically located in different 
data files. The linked list is arranged as a plurality of 

5 nodes where each node represents a single file seg- 
ment and the linked list orders all of the file segments 
to make up the entire multimedia file. Accordingly, 
editing can be performed at the data unit level so that 
both compressed and uncompressed files can be 

10 handled. Editing operations on the file result in 
changes to this linked-list structure instead of the file 
itself, thus avoiding the necessity of making file cop- 
ies. 

More particularly, the linked-list structure con- 

15 sists of a list of records called "file descriptor nodes". 
Each node comprises a record which contains infor- 
mation about a corresponding file segment, includ- 
ing, the address of the physical file in which the seg- 
ment is located, the physical position of the segment 

20 in its file, the length in data units of the segment and 
a "logical starting position" number which indicates 
the position of the file segment relative to other seg- 
ments in the overall multimedia file so that a particu- 
lar segment can be located during a seek operation. 

25 Initially, the entire file is considered to be a single 

segment and can be described by a single node. How- 
ever, during the editing process when information is 
inserted or deleted, additional nodes are created and 
added to the list Therefore, all file updates, including 

30 overwrites, deletions and inserts are list manipula- 
tions rather than actual file manipulations, and, ac- 
cordingly, changes can be processed very rapidly. 

Separate file manipulation lists are maintained in 
order to provide undo and journaling capability. 

35 These file manipulation lists store "snapshots" of the 
file descriptor lists at selected periods of time and can 
be used to reset the state of the file manipulation list 
in order to provide undo and redo capabilities. 

40 BRIEF DESCRIPTION OF THE DRAWINGS 

The above and further advantages of the inven- 
tion may be better understood by referring to the fol- 
lowing description in conjunction with the accompa- 

45 nying drawings, in which: 

Figure 1 is a block schematic diagram of a com- 
puter system, for example a personal computer 
system, in which the method and apparatus ac- 
cording to the present invention can operate; 

so Figure 2 is a block diagram of a section of a file 

descriptor list illustrating the contents of two se- 
lected nodes constructed according to the inven- 
tion; 

Figure 3 is a schematic diagram indicating the 
55 content and structure of a single initial node con- 

structed according to the invention and which is 
associated with a newly-opened file. 
Figure 4 is a an illustrative flowchart of the ma- 
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nipulation of a linked-list structure to perform an 
insertion into a multimedia file in a preferred 
method according to the invention; 
Figure 5 is an illustrative flowchart of the manip- 
ulation of a linked-list structure to perform a de- 5 
letion of selected sections of a multimedia file in 
a preferred method according to the invention; 
Figures 6A and 6B, when placed together, form 
an illustrative flowchart of a preferred method ac- 
cording to the invention used to manipulate the 10 
linked-list structure to overwrite all or part of mul- 
timedia file; 

Figure 7 is a block schematic diagram of two se- 
lected nodes of an illustrative file manipulation 
list used for undo and journaling operations in a 15 
preferred embodiment of apparatus according to 
the invention; and 

Figure 8 is an illustrative flowchart of a preferred 
method used to maintain the file manipulation list 
of figure 7 during an undo and a redo operation. 20 

DETAILED DESCRIPTION OF ILLUSTRATIVE 
EMBODIMENTS 

The invention is preferably practised in the con- 25 
text of an operating system resident on a personal 
computer such as the IBM® or Apple®Macintosh® 
computer. A representative hardware environment is 
depicted in Figure 1, which illustrates a typical hard- 
ware configuration of a computer 100 in accordance 30 
with the subject invention. The computer 100 is con- 
trolled by a central processing unit 102 (which may be 
a conventional microprocessor) and a number of 
other units, all interconnected via a system bus 108, 
are provided to accomplish specific tasks. Although a 35 
particular computer may only have some of the units 
illustrated in Figure 1, or may have additional compo- 
nents not shown, most computers will include at least 
the units shown. 

Specifically, computer 100 shown in Figure 1 in- 40 
eludes a random access memory (RAM) 106 for tem- 
porary storage of information, a read only memory 
(ROM) 1 04 for permanent storage of the computer's 
configuration and basic operating commands and an 
input/output (I/O) adapter 110 for connecting periph- 45 
era! devices such as a disk unit 113 and printer 114 to 
the bus 108, via cables 115 and 112, respectively. A 
user interface adapter 116 is also provided for con- 
necting input devices, such as a keyboard 120, and 
other known interface devices including mice, speak- so 
ers and microphones to the bus 108. Visual output is 
provided by a display adapter 118 which connects the 
bus 108 to a display device 1 22, such as a video mon- 
itor. The workstation has resident thereon and is con- 
trolled and coordinated by operating system software 55 
such as the OS/2® operating system developed and 
sold by the International Business Machines Corpor- 
ation, Boca Raton, Florida. 



In accordance with conventional storage techni- 
ques, each f ile which is stored on data storage device 
or located in the system main memory is comprised 
of a number of file "blocks" and an index file which in- 
dicates, in sequence, where each block is located so 
that the file can be reconstructed by storing or retriev- 
ing the blocks in the sequence indicated by the file in- 
dex. The problem with such an arrangement is that 
the block size is often optimized so that it is compat- 
ible with buffer and cache sizes and generally con- 
sists of a large number of bytes (for example, 256 or 
512 bytes). Consequently, such afile cannot be easi- 
ly edited by manipulating the index file because the 
large block size causes problems with compressed 
files. 

In accordance with the present invention, apart 
from the conventional file structure, each multimedia 
file is represented by a file descriptor list and two file 
manipulation lists. The file descriptor list is a linked- 
list of file descriptor "nodes" where each of the nodes 
holds selected information that describes the location 
and length of a file segment. For example, a section 
of such a linked-list is shown in Figure 2. The illustrat- 
ed list section consists of node 200 and node 202; ad- 
ditional nodes may be present in the list which de- 
scribes a single multimedia file, however, these addi- 
tional nodes contain the same type of information as 
nodes 200 and 202 and are not shown for clarity. 

Each node, for example, node 200, is associated 
with a file segment and contains information regard- 
ing the length of the file segment and its location both 
in the physical file where the segment is actually lo- 
cated and the location of the segment in the overall 
multimedia file which is comprised of a plurality of file 
segments. The file segment has a size which de- 
pends on the editing operation used to create the seg- 
ment. The size is preferably expressed in data units 
of one byte length, but may be expressed in other data 
units (for example, bits) depending on the type of 
sampling and editing operations which are being per- 
formed. In the discussion herein, file sizes and loca- 
tions will be expressed in terms of bytes for the sake 
of clarity without any intention of limiting the discus- 
sion to that particular data unit. The size may range 
from zero bytes in the case where an empty file is be- 
ing inserted into the multimedia file to many thou- 
sands of bytes in the case of a large insertion. 

More particularly, each node comprises five 
pieces of information regarding the associated file 
segment: a file handle 204 which identifies a physical 
file 224 in which the segment is located (generally 
such a file "handle" is returned in a well-known man- 
ner by the operating system when a new file is 
opened), the physical position 206 of the associated 
segment in the file identified by the file handle 204 
(this number is essentially an "offset" expressed in 
terms of bytes from the beginning of the file), the log- 
ical starting position 208 of the file segment within the 
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overall multimedia file (a monotonically increasing 
number used to locate a particular data unit within the 
multimedia! He), the length 210 of the file segment ex- 
pressed in bytes and a pointer 212 which identifies 
the location of the next node (illustrated as node 202 
in Figure 2) in the linked-list. Therefore each data unit 
which comprises the file segment has both a physical 
position in its actual file and a logical position in the 
overall multimedia file. Since the data units in each 
file segment are contiguous, instead of keeping the 
physical and logical positions for each data unit in a 
node, the physical and logical starting positions and 
the number of data units (length) of the file segment 
are stored in each node. 

In node 200, the physical position 206 represents 
the actual physical location of the beginning of the as- 
sociated file segment data from the beginning of the 
data area in the file. Generally, the data area of the 
file will start at a different disk address that differs 
from the disk address that corresponds to the file 
handle because most multimedia files include a 
header at the beginning of the file. This header in- 
cludes information concerning the file type, coding 
arrangement, sampling rate (the number of samples 
per second taken by the encoding device), the preci- 
sion (the number of data bits per sample) and the 
number of channels. This header generally has a 
fixed length so that the disk address of the start of the 
data (physical position 0) can be determined from the 
file handle by adding the length of the header. 

Finally node 200 concludes with a pointer 212 
which contains the address of the start of the next 
node 202. In a manner similar to node 200, node 202 
comprises a file handle 214 (which identifies the lo- 
cation of file 226), physical position information 216, 
logical starting position information 218, length infor- 
mation 220 and a pointer 222 to the next node (not 
shown). The logical starting position information in 
node 202 follows sequentially from the logical starting 
position of node 200 and its length in data units. For 
example, if node 200 had a logical starting position of 
10 and a length of 5 bytes, then the logical starting 
position of node 202 would be 15. During editing op- 
erations, the logical starting position of each node is 
adjusted to keep the logical starting positions of the 
data units sequential. 

When a linked-list structure such as that shown 
in Figure 2 is associated with a file, initially the file is 
described by a single node. However, after the file is 
edited (information is inserted or deleted) additional 
nodes are created as will be described in detail below. 
Since all file updates are manipulations of a linked- 
list structure such as that shown in Figure 2, rather 
than actual file manipulations, the editing changes 
occur very rapidly. 

The relationship of a file segment 322 and the as- 
sociated file descriptor node 300 is shown in Figure 
3. In particular, file 302, as previously described, con- 



sists of a header portion 304 and a data portion 306. 
The file handle information 308 of node 300 is the file 
handle of the file 302 in which segment 322 is located 
as indicated by arrow 310. The physical position sec- 

5 tion 312 of file descriptor node 300 indicates the start 
of the file segment data portion 322 as indicated by 
arrow 314. The logical starting position section 316 
refers to the logical position of the first data unit of the 
associated file segment in the multimedia file which 

10 is described by the entire file descriptor node list. In 
the case of a file which has not been edited, the length 
of the file 318 corresponds to the length the file seg- 
ment 322 in bytes and pointer 320 points to the next 
file descriptor node (not shown). 

15 When a file is initially opened, one file descriptor 

node is created with a length parameter equal to the 
actual length of the file. For newly-created files, the 
node is created with the length of zero. The physical 
position information is set to point to the first data byte 

20 of the data file (physical position 0) while the logical 
starting position information is set to "0". Since no 
data has been written to the newly-opened file, the 
node descriptor file handle is the original file handle. 
The aforementioned file descriptor node list can 

25 be used to perform editing operations on a multime- 
dia file. Figures 4-8 show illustrative flowcharts of 
methods used to manipulate the list to perform inser- 
tion, deletion and overwrite editing functions. These 
methods cooperate with another routine, or a p plica- 

30 tion program, which identifies the point (or logical 
unit) at which insertions and deletions are to be made. 
For example, such an application program might con- 
sist of a well-known visual editing program in which a 
screen display is generated which illustrates the 

35 sound waveform of a recorded sound. 

By appropriately manipulating the display (for ex- 
ample, using a cursor to select a point on the dis- 
played waveform), a point in the sound waveform at 
which an insertion or deletion is to be made is identi- 

40 fied by the editing application program. The editing 
program then converts this point into a logical posi- 
tion at which point editing is to be performed. Once 
the appropriate logical position has been identified, 
the application program issues a "seek" request to 

45 cause the inventive file manipulation routines to lo- 
cate the file descriptor node where the editing oper- 
ations will take place. The correct node can be locat- 
ed because each node contains the logical starting 
position of the data units in the file segment and the 

so length of the file segment and, thus, the logical posi- 
tion of the last data unit in the node can be easily cal- 
culated. The seek request causes the file manipula- 
tion routine to traverse the node list until a node is lo- 
cated which contains the data unit with the requested 

55 logical position. 

When the position is located, editing proceeds as 
shown in the method steps illustrated in Figures 4, 5 
and 6. In particular, Figure 4 describes the steps in an 
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illustrative routine which can be used to insert infor- 
mation into a file segment described by a file descrip- 
tor node at a requested insertion point (as identified 
by a requested logical position) called the "current" 
node. An assumption is made in the discussion of the 
following routines that information to be inserted into 
a file is located in another separate file. The routine 
starts at step 400 and proceeds to step 402, where a 
determination is made whether the insertion is occur- 
ring at the endpoint of the associated file. This deter- 
mination can be made from the information in the 
node by adding the file segment length to the data 
unit logical starting position to calculate the logical 
position of the last data unit in the node position and 
comparing this logical position to the requested inser- 
tion point. 

If the insert is occurring at the end point, then, in 
step 403, a new file descriptor node is created which 
new node contains the file handle, physical position 
and length of the data which is to be inserted. The log- 
ical starting position is set to the logical position of the 
current node plus the current node length plus one. 
This newly-created filed descriptor node is then in- 
serted into the node linked list after the current node 
end as indicated by step 404. This node insertion is 
performed by changing the pointer of the current 
node to point to the new node and setting the pointer 
information in the new node to point to a node (if any) 
which follows the current node in the node list The 
routine then proceeds to end in step 418. 

Alternatively, if in step 402, it is determined that 
the insertion is not occurring at the end point of the 
current file descriptor node, then the insertion is oc- 
curring between the logical beginning of the node and 
the logical end. Consequently, the current node must 
be divided into two nodes to allow insertion of the in- 
formation as indicated in step 406. This division is 
done by creating a new node and copying the infor- 
mation in the current node to create a "left" node and 
a "right" node. 

Next, in step 408, the length information in the left 
node is reduced so that its total length corresponds 
to the portion of the current node which occurs before 
the insertion point and the length of the right node is 
reduced so that its total length corresponds to the 
portion of the current node which occurs after the in- 
sertion point. The total length remains the same but 
is simply divided between the left and right nodes. 
Then, in step 410, the logical starting position infor- 
mation of the right node is incremented by the length 
of the insertion data. 

Next, in step 412, a new node is created which 
contains information that describes the file segment 
containing the inserted data including the file handle, 
physical position, logical position and length of the in- 
serted data. The logical starting position is set to the 
logical starting position of the left node plus its length. 
This new node is then connected to the right and left 



nodes by changing the pointer information in the left 
node to point to the beginning of the new node and 
changing the pointer information and the new node to 
point to the beginning of the right node. 
5 Next in step 414, the logical starting positions of 

all nodes following the insertion point (including the 
right node) are incremented by the length (number of 
logical units) of the inserted file segment. Finally, in 
step 416, the file manipulation lists are updated so 
10 that data recovery and journaling operations will be 
possible (the construction and manipulation of the 
file manipulation lists will be discussed below in con- 
nection with Figures 7 and 8). The routine then finish- 
es in step 418. 
15 Figure 5 discloses an illustrative method by 

which the file descriptor lists are manipulated in order 
to delete data from the multimedia file. As previously 
mentioned, the deletion routine cooperates with an 
editing application which issues a seek request to the 
20 point where the deletion will occur and supplies the 
length of the deletion. The inventive deletion routine 
begins in step 500 and proceeds to step 502 where a 
determination is made whether the deletion is entirely 
contained within the file segment described by the 
25 current file descriptor node. If it is, the routine pro- 
ceeds to step 504 in which a determination is made 
whether the deletion consumes the entire file seg- 
ment. 

if, in step 504, the deletion is less than the entire 

30 file segment, the routine proceeds to step 506 where 
the length of the node is reduced to account for the 
number of logical units which are deleted, The routine 
then proceeds to step 524 where the file manipulation 
lists are updated so that data recovery and journaling 

35 operations can take place as described below and the 
routine finishes in step 526. 

Alternatively, if, in step 504, a determination is 
made that the deletion does consume the entire node, 
then, in step 508, the node is removed by changing 

40 the pointers of the preceding node to point the suc- 
ceeding node. 

Subsequently, in step 510, a determination is 
made as to whether at least one node exists after the 
node removal in step 508. Such an occurrence may, 

45 for example, happen when the entire file is deleted. 
If the node removal removes the last remaining node, 
a default node with a length of zero is created. The 
routine then proceeds to step 522 where the logical 
starting positions of all nodes following the deleted 

so area are reduced by the length of the deletion in order 
to keep the logical starting positions consecutive. In 
step 524, the file manipulation lists are updated and 
the routine finishes in step 526. 

If, in step 502, a determination is made that the 

55 portion of the file to be deleted extends beyond the 
file segment contained within the current node, then 
the routine proceeds to step 514 in which the current 
node is removed (by manipulating the pointers as de- 
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scribed above), making the next node in the node list 
the "current" node. Next, in step 516, a determination 
is made whether the total logical length to be deleted 
has been removed from the file descriptor list by the 
removal of the current node. If not, the routine pro- 
ceeds back to step 502 where the new "current" node 
is checked to determine whether the remaining "to be 
deleted" portion of the file is contained within the new 
current node. If not, the routine proceeds to step 514. 
Alternatively, the routine proceeds to step 504. 

Operation continues in this manner until the total 
logical length of the removed nodes equals the total 
logical length of the deletion, at which point the rou- 
tine proceeds to step 522. where the logical starting 
positions of all nodes following the deleted area are 
reduced by the length of the deletion in order to keep 
the logical starting positions consecutive. In step 524, 
the file manipulation lists are updated and the routine 
finishes in step 526. 

Figures 6Aand 6B disclose an illustrative method 
for manipulating the file descriptor lists in the case 
where a portion of the multimedia file is to be over- 
written by new data. Again, the associated editing 
program requests a seek to a particular logical posi- 
tion, thereby identifying the node in which the over- 
write operation is to take place. The associated edit- 
ing program also provides the information which is to 
overwrite portions of the file and its length. 

In particular, the routine starts in step 600 and 
proceeds to step 602 where a determination is made 
whether the requested overwrite operation will over- 
write all or only part of the file segment described by 
current node. If all of the current node file segment is 
to be overwritten, the routine proceeds to step 604 
where an additional determination is made whether 
the requested overwrite information will overwrite the 
file segment exactly. If so, in step 606, the file handle 
stored in the current node is changed to identify the 
new file segment and, in step 608, the physical posi- 
tion of the new node is updated to correspond to the 
start of the data in the new file segment. The routine 
then proceeds, via off-page connectors 632 and 640 
to step 660 where the file manipulation lists are up- 
dated to provide for data recovery journaling opera- 
tions and the routine ends in step 662. 

Alternatively, if in step 604, a determination is 
made that the requested overwrite operation will not 
overwrite exactly the entire current node, then the re- 
quested overwrite operation must be an overwrite of 
only a part of the current node. Consequently, the 
routine proceeds to step 610 where a determination 
is made whether the overwrite point begins at the 
start of the current node. If the request does begin at 
the start of the node, the routine proceeds to step 622 
in which a new file descriptor node is created with a 
file handle, physical position, logical position and 
length corresponding to the file segment which is to 
overwrite the current segment in the multimedia file. 
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Then, in step 624, the physical position of the cur- 
rent node is increased and the length is decreased to 
account for the length of the overwriting information. 
Finally, the new node describing the overwriting infor- 

5 mation is inserted into the linked-list of file descriptor 
nodes before the current node (in a conventional 
fashion by manipulating the node pointers) as indicat- 
ed in step 626. The routine then proceeds, via off-pa- 
ge connectors 628 and 636 to step 660 where the file 

10 manipulation list are updated and the routine finishes 
in step 662. 

However, if, in step 610, a determination is made 
that the requested overwrite does not start at the be- 
ginning of the current node, then the routine pro- 
fs ceeds, via off-page connectors 630 and 638, to step 
642 where a determination is made whether the over- 
write request stops at the end of the current node. If 
it does, the routine proceeds to step 646 in which a 
new node is created with the file handle, physical pos- 
20 ition and length of the overwriting information. The 
length of the current node is reduced in step 634 by 
the length of the overwriting information and the new 
node created in step 646 is inserted before the current 
node in step 654. The routine then proceeds to steps 
25 660 and 662 as previously described. 

If, in step 642, it is determined that the requested 
overwrite does not stop at the end of the node, then 
the request is to overwrite a portion of the data which 
is located in the middle of the file segment described 
30 by the current node (note that, in step 604, it was de- 
cided that the whole current node was not being over- 
written). In this case, the current node must be split 
into two nodes in order to preserve the data which is 
NOT being overwritten. Consequently, the routine 
35 proceeds to step 644 where is a new node is created 
for the remaining data located after the overwritten 
segment. This new node has the same file handle as 
the current node, but the physical position and the 
logical position are increased from the current node 
40 by the length of the overwriting file segment plus the 
length of the file segment located before the over- 
write point. 

Next, in step 652, the length of the current node 
is reduced to account for the overwritten file portion 

45 and the routine proceeds to step 656 where a new 
node is created for the overwriting data using the file 
handle, physical position and length of the overwrit- 
ing data. The logical position is set to the logical pos- 
ition of the current node plus the initial segment that 

so is not being overwritten. In step 658 this latter new 
node is inserted into the linked-list after the current 
node by updating the pointer information in the list us- 
ing conventional routines. The routine then proceeds 
to steps 660 and 662 and operates as previously de- 

55 scribed. 

However, returning to step 602, if it is determined 
that the requested overwrite operation is going to 
overwrite more nodes than just the current node, then 
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the routine proceeds to step 612 where the length of 
the current node is reduced by the length of the file 
segment that is being overwritten. In step 614 a de- 
termination is made whether the length of the current 
node is zero. If the length of the current node has 5 
been reduced to zero, the node is removed from the 
linked-list in step 616. Then, in step 618, a determi- 
nation is made whether the length of the file segment 
which is removed by removing the current node is 
equal to the total length to be removed. If not, the rou- 10 
tine proceeds back to step 602 Where the next node 
in the list becomes the current node and the operation 
is repeated. 

Alternatively, if the removal of the current node 
caused total logical length removed to be equal to the is 
total length to be overwritten, then the routine pro- 
ceeds, via off-page connectors 620 and 634, to step 
664 where a new node is created to describe the in- 
formation which is being written to the file. This infor- 
mation includes the file handle, physical and logical 20 
positions and length of the overwriting data. In step 
666, this latter new node is connected between the 
original node and the remainder of nodes in the list. 
The routine then proceeds to step 660 and 662, as 
previously described. 25 

The present invention also provides for two addi- 
tional linked lists which are used to provide data re- 
covery and journaling operations. Data recovery op- 
erations generally allow the state of the system to be 
"backed up" to its state before the immediately previ- 30 
ous editing operation. Alternatively, journaling in- 
volves re-performing an editing step which was just 
"undone" by a data recovery operation. One of the ad- 
ditional linked lists is used for data recovery (or undo), 
and the second list is used for journaling (or redo) op- 35 
erations. Each list consists of a set of linked "file ma- 
nipulation" nodes and the file manipulation lists are 
used to insure that any editing operation (such as an 
insertion, deletion or overwrite operation) which was 
performed can be both undone and redone. 40 

To this latter end, each file manipulation node 
contains a •snapshot" of the linked-list file descriptor 
nodes in the period of time which occurs right after an 
insertion, a deletion or an overwrite. As each editing 
action is performed a new file manipulation node is 45 
created detailing the state of the system after the op- 
eration and added to the beginning of the data recov- 
ery linked-list. In general, if an action is to be undone 
the first file manipulation node in the data recovery 
is transferred from the data recovery list to the begin- so 
ning of the journaling list. Then the new first node in 
the data recovery list is used to reset the state of the 
system in order to "undo" the effects of the previous 
editing operation. 

Similarly, in order to "redo" an undone editing op- ss 
eration the first file manipulation node in the journal- 
ing list is transferred from the journaling list to the be- 
ginning of the data recovery list. This new first node 



in the data recovery list is then used to reset the state 
of the file descriptor list in order to redo the undone 
editing operation. 

Figure 7 shows the layout of the f ile manipulation 
nodes in each of the two separate file manipulation 
lists. In particular, Figure 7 shows a portion of a 
linked-list consisting of two nodes: node 700 and 
node 702. Node 700 comprises several different in- 
formation sections each of which consists of a copy 
of the contents of selected file descriptor nodes in the 
file descriptor linked-list at the time when the list 
"snapshot" was taken. In particular, section 704 is a 
copy of the contents of the first file descriptor node 
in the file descriptor linked list at the time the snap- 
shot was taken. Similarly, section 706 comprises the 
contents of the "current" f ile descriptor node at the 
time of the snapshot, and section 708 comprises the 
contents of the file descriptor node which follows the 
current file descriptor node. Information in section 
710 contains a file size snapshot which is the maxi- 
mum size of the file at the time the snapshot was tak- 
en (this data is necessary since the file can grow or 
shrink depending on the editing action). Finally, the 
file manipulation node is completed by a pointer 712 
which points to the beginning of the next node 702. 

Node 702 also comprises the contents of the first 
file descriptor node 714, the current file descriptor 
node, the next file descriptor node, a file size snap- 
shot 720 and a pointer to the next file manipulator 
node 722. The information describing the "snapshot" 
which is stored in file manipulator node 702 is obvi- 
ously different from that described in file manipulator 
node 700 since the snapshots are taken at different 
times. After each editing action that can change the 
state of the multimedia file, a snapshot of the linked- 
list file descriptor nodes is saved by creating a new 
file manipulation node and adding it to the data recov- 
ery list. 

The file manipulator lists are used in a manner 
described in connection with Figure 8. In particular, 
the update of the file manipulator lists starts in step 
800 and proceeds to step 802. In step 802, a deter- 
mination is made whether user wishes to undo a pre- 
vious editing. Such a determination would be made by 
user interaction with the editing application in a con- 
ventional manner. If an undo action is requested, the 
routine proceeds to step 808 in which the first node 
in the data recovery (undo) file manipulator list is re- 
moved from the list making the next node the newf irst 
node. The removed node information is inserted into 
a new node which is added to the beginning of the 
data journaling list. 

The routine then proceeds to step 814 where all 
of the state information associated with the first node 
of the data recovery list is used to reset the state of 
the file descriptor node list The routine then ends in 
step 816. 

Alternatively, if, in step 802, it is determined that 
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an undo action is not requested the routine proceeds 
to step 804 in which a determination is made whether 
a redo action is requested. If a redo action is not re- 
quested the routine ends in step 816. 

Alternatively, if a redo action is requested in step 
804, the routine proceeds to step 808 in which the first 
node in the journaling (redo) file manipulator list is re- 
moved from the list making the next node the new first 
node. The removed node information is inserted into 
a new node which is added to the beginning of the 
data recovery list. 

The routine then proceeds to step 814 where all 
of the state information associated with the first node 
of the data recovery list is used to reset the state of 
the file descriptor node list. The routine then ends in 
step 816. 



Claims 

1. Apparatus for editing a multimedia file comprised 
of a sequential plurality of data units (306, 322) 
generated by sampling an analog signal and en- 
coding each sample as a data unit, and each of 
the plurality of data units being located in a phys- 
ical file (302) having an address (308) indicating 
the start of the physical file and a physical file 
length (318), the apparatus operating under con- 
trol of an editing application and comprising: 

means for constructing a node (300) rep- 
resenting a sequential plurality of data units (306) 
comprising a segment (322) of the multimedia 
file, the node comprising the physical file ad- 
dress (308), a physical position (312) of the rep- 
resented file segment in the physical file, a logi- 
cal starting position (316) indicating the position 
of the represented file segment in the multimedia 
file and the number (318) of data units in the rep- 
resented file segment; and 

editing means (Figs. 4, 5, 6) responsive to 
editing commands generated by the editing appli- 
cation for changing information contained in the 
node in order to edit the represented file seg- 
ment. 

2. Apparatus for editing a multimedia file according 
to Claim 1 wherein the multimedia file comprises 
a plurality of file segments, each having a phys- 
ical file address and a physical file length, the ap- 
paratus further comprising means for construct- 
ing a linked list comprising a plurality of nodes 
(200, 202), each of the plurality of nodes repre- 
senting a sequential plurality of data units com- 
prising one of the plurality of file segments, each 
node comprising an address (204, 214) of a phys- 
ical file in which the represented file segment is 
located, a physical position (206, 216) of the rep- 
resented file segment in the physical file, a logi- 



cal position (208, 218) indicating the position of 
the represented file segment in the multimedia 
file and the number (21 0, 220) of data units in the 
represented file segment. 

5 

3. Apparatus according to Claim 2 in which said 
editing means includes means (Figs. 4 and 5) for 
inserting nodes into the linked list and deleting 
nodes from the linked list in order to insert and de- 

10 lete file segments from the multimedia file. 

4. Apparatus for editing a multimedia file according 
to Claim 3 in which said editing means further in- 
cludes means (406-41 6) for splitting a node in the 

15 linked list into two nodes and for inserting a new 

node between the two nodes in order to insert in- 
formation into the multimedia file. 

5. Apparatus according to Claim 3 in which said 
20 editing means further includes means for split- 
ting nodes in the linked list into a first and second 
node and for linking the first node to a following 
node in order to delete information from the mul- 
timedia file. 

25 

6. Apparatus according to Claim 4 in which said 
editing means is effective to insert the new node 
into the linked list at an insertion point indicated 
by the editing application. 

30 

7. Apparatus according to Claim 6 wherein the edit- 
ing means compares the insertion point to the 
logical starting position information in each node 
to determine where in the linked list the new node 

35 is to be inserted. 

8. Apparatus according to Claim 7 wherein the edit- 
ing means is arranged to insert the new node be- 
fore a first existing node if the insertion point is 

40 at the beginning of the first existing node and to 

insert the new node after a second existing node 
if the insertion point is at the end of the second 
existing node and to split an existing third node 
into two partial nodes and insert the new node be- 

45 tween the two partial nodes if the insertion point 

is within the third existing node. 

9. Apparatus as claimed in Claim 2 in which said 
editing means includes: 

so means, responsive to a command to over- 

write a predetermined number of data units in the 
multimedia file at an overwrite point from an 
overwrite file segment contained in an overwrite 
file, for changing information contained in a node, 

55 which node represents a file segment containing 

the overwrite point in order to remove a portion of 
the file segment from the multimedia file; 

means responsive to said command to 
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overwrite a predetermined number of data units 
in the multimedia file at an overwrite point, for 
creating a new node comprising an address of the 
overwrite file, a physical position of the overwrite 
file segment in the overwrite file, a logical start- 5 
ing position indicating the position of the first data 
unit in the overwrite file segment in the plurality 
of data units in the multimedia file and the num- 
ber of data units in the overwrite file segment; 
and 10 

means responsive to said command to 
overwrite a predetermined number of data units 
in the multimedia file for inserting the new node 
into the linked list at the overwrite point. 

15 

10. A method for editing a multimedia f ile comprised 
of a sequential plurality of data units (306, 322) 
generated by sampling an analog signal and en- 
coding each sample as a data unit, and each of 

the plurality of data units being located in a phys- 20 
ical file (302) having an address (308) indicating 
the start of the physical file, the method operating 
in cooperation with an editing application and 
comprising the steps of: 

constructing a node (300) representing a 25 
sequential plurality of data units (306) comprising 
a segment (322) of the multimedia file, the node 
comprising the physical file address (308) f a 
physical position (312) of the represented file 
segment in the physical file, a logical starting 30 
position (316) indicating the position of the repre- 
sented file segment in the sequential plurality of 
data units in the multimedia file and the number 
(318) of data units in the represented file seg- 
ment; and 35 

changing information contained in the 
node in order to edit the represented file segment 
in response to editing commands generated by 
the editing application. 

40 

11. A method according to Claim 10 comprising the 
further step of: 

constructing a linked list comprising a plur- 
ality of nodes (200, 202), each of the plurality of 
nodes representing a sequential plurality of data 45 
units comprising a segment of the multimedia 
file, each node comprising an address (204, 214) 
of a physical file in which the represented file 
segment is located, a physical position (206, 216) 
of the represented file segment in the physical so 
file, a logical position (208, 218) indicating the 
position of the represented file segment in the 
plurality of logical units in the multimedia file and 
the number (210, 220) of data units in the repre- 
sented file segment 55 

12. A method according to Claim 11 comprising the 
further step of: 



inserting nodes into the linked list and de- 
leting nodes from the linked list in response to 
commands generated by the editing application 
in order to insert and delete file segments from 
the multimedia file. 

13. A method according to Claim 12 comprising the 
further step of: 

splitting a node in the linked list into two 
nodes; and 

inserting an additional node between the 
two nodes in response to commands generated 
by the editing application in order to insert infor- 
mation into the multimedia file. 

14. A method according to Claim 12 comprising the 
further steps of: 

splitting nodes in the linked list into a first 
node and a second node; and 

linking the first node with a succeeding 
node in response to commands generated by the 
editing application in order to delete information 
from the multimedia file. 
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